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(54) Method of transmitting layered video-coded information 



(57) Video-coded information is transmitted over a 
network at a priority level that is determined based on 
feedback from the network. In an embodiment, the feed- 
back comprises a response to a request for information 
on whether the network currently has the available ca- 
pacity to transmit additional high priority traffic. In an em- 



bodiment, a candidate base layer frame is transmitted 
over the network as a base layer frame if permission to 
send high priority data was granted and is transmitted 
over the network as an enhancement layer frame if per- 
mission to send high priority data was denied. In a fur- 
ther embodiment, the candidate base layer frame is de- 
leted if permission to send high priority data was denied. 
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Description 

Technical Field 

[0001] Embodiments of the present invention relate to 
transmitting video information over a network. In partic- 
ular, embodiments of the present invention relate to 
methods for setting a transmission priority for layered 
video-coded information that is to be transmitted over a 
network. 

Background of the Invention 

[0002] One of the most promising applications in the 
field of communications is the transmission of encoded 
or compressed video information across mediums such 
as telephone networks, cable television networks, and 
the Internet. The video information is typically encoded 
at one location, transferred over a network to a destina- 
tion, and decoded at the destination. A video encoder 
may be used to, among other things, receive video sig- 
nals and other data, convert these to digitized form (if 
the data is not already in digitized form), and compress 
the data using an encoding algorithm. Examples of vid- 
eo encoding algorithms are the MPEG-1 , MPEG-2, and 
MP EG -4 digital video-coding standards of the Motion 
Picture Expert Group and the H.261 and H.264 stand- 
ards from the ITU-T (International Telecommunications 
Union-Telecommunications sector). The video informa- 
tion may be first obtained from a video camera that gen- 
erates video signals which contain a series of video 
frames that each depict images. In addition, the video- 
coded information may also include other components 
such as, for example, animations, text, and/or audio in- 
formation. A video decoder may be used at the destina- 
tion to decode the received video-coded frames into a 
f ormat that may be displayed by a video monitor or other 
device. 

[0003] The networks over which video-coded infor- 
mation is transmitted generally have limited bandwidth. 
The amount of bandwidth available at any given time 
depends upon factors such as the amount of traffic and 
the operability of network components. The amount of 
available bandwidth is a major parameter for the quality 
of the video presented by the video decoder, with an in- 
crease in bandwidth increasing the quality of the video. 
The unavailability of bandwidth may cause video-coded 
frames to be lost or delayed while being sent across the 
network due to network congestion or buffer overflow. 
Such losses and delays may cause severe degradation 
in perceived quality of the video displayed by the video 
decoder and may result in error propagation, especially 
where the video is sent in real-time or streamed or where 
the video contains objects in motion. 
[0004] One way to combat the impact of limited band- 
width is to use a "layered" video-coding scheme. Lay- 
ered video-coding schemes divide a stream of video- 
coded frames into layers. In the standard layered video- 



coding scheme, the video-coded information signal is 
divided into a base layer and an enhancement layer. The 
enhancement layer typically provides refinement infor- 
mation that is added to the base layer to provide higher 

5 quality. For example, the base layer may typically be de- 
coded and displayed without any data from the en- 
hancement layer, although this would probably result in 
reduced picture quality. When network congestion oc- 
curs, packets may be dropped from the enhancement 

10 layer, but valid video at a slightly lower quality may still 
be produced by decoding packets from the base layer. 
[0005] Traffic that is sent over a n etwo rk is often clas- 
sified by a priority level. In many networks, the priority 
level will be used if the network needs to drop some of 

15 the packets being transported. For example, if network 
congestion occurs and the network has to drop packets, 
the network will typically drop the lower level packets. A 
video encoder may take advantage of these classifica- 
tions by designating some video-coded frames as high 

20 priority and the rest as low priority. For example, every 
fifth frame may be sent as high priority, with the rest be- 
ing sent as low priority. A typical layered video-coding 
scheme is to transmit enhancement layer traffic over the 
network with a lower priority than the base layer. Another 

25 scheme, which is referred to as using multiple threads, 
codes the base layer frames independently, using only 
previous base layer frames for motion compensation, 
and codes the enhancement layer frames normally, us- 
ing both base and enhancement layer frames for motion 

30 compensation. 

[0006] A problem may occur when using a layered 
video-coding scheme if there are simultaneous attempts 
to transmit high priority base layer frames. If this occurs, 
the network may become overloaded with high priority 

35 data. In this case, either base layer frames may be lost, 
causing drastic quality reduction, or the network may be 
forced to buffer some of the base layer frames, causing 
excessive delays. 

40 Summary of the Invention 

[0007] Embodiments of the present invention allevi- 
ate degradation in a layered video-coded system by us- 
ing feedback from the network indicating whether or not 

45 capacity is available for sending the high priority frames. 
Hie feedback may include a response to a request for 
information on whether the network currently has the 
available capacity to transmit additional high priority 
traffic. In an embodiment, a candidate base layer frame 

so is transmitted over the network as a base layer frame if 
permission to send high priority data was granted and 
is transmitted over the network as an enhancement lay- 
er frame if permission to send high priority data was de- 
nied. In a further embodiment, a candidate base layer 

55 frame is deleted if permission to send high priority data 
was denied. 
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Brief Description of the Drawings 
[0008] 

FIG. 1 is a block diagram of a system including a 
video encoder and decoder according to an embod- 
iment of the present invention. 
FIG. 2 is a block diagram of a video encoder accord- 
ing to an embodiment of the present invention. 
FIGS. 3-7 are flow diagrams of methods of trans- 
mitting video information according to embodi- 
ments of the present invention. 

Detailed Description of the Invention 

[0009] The present invention provides an improved 
method of transmitting layered video-coded data by us- 
ing network feedback which indicates whether band- 
width is available to send high priority frames (e.g., base 
layer frames). In an embodiment, the encoder does not 
decide a priori which frames are to be transmitted as 
base layer frames, but rather requests permission from 
the network to transmit high priority data before encod- 
ing a candidate base layer frame. In this embodiment, 
the candidate-base layer frame may either be encoded 
and transmitted as a base layer frame if permission to 
send high priority data is granted or may be transmitted 
as a low priority frame, or deleted from transmission, if 
permission to send high priority data was dented. This 
and other embodiments are described in more detail be- 
low. By using an embodiment of the present invention, 
the likelihood of network overload is minimized because 
the arrival of high priority data into the network is rand- 
omized. In addition, embodiments of the invention avoid 
buffering large amounts of data and thus avoid the delay 
that such buffering may cause. Use of the present in- 
vention may therefore alleviate degradation of per- 
ceived picture quality due to loss of frames or buffering 
delays. 

[0010] FIG. 1 is a block diagram of a system including 
a video encoder and decoder according to an embodi- 
ment of the present invention. FIG. 1 shows a video en- 
coder 110 and a video decoder 120 both of which are 
coupled to a network 130. The term "coupled" is intend- 
ed to encompass and be broader than the term "directly 
connected." As discussed below, encoder 1 1 0 or anoth- 
er device may transmit video-coded data (such as vid- 
eo-coded frames 113) to decoder 120 across network 
130 at a priority level that is determined using informa- 
tion about the network's available capacity (such as net- 
work capacity information 1 1 6). This information may be 
provided in response to a request for such information 
(such as network capacity request 115). Of course, the 
present invention is not limited to the system shown in 
FIG. 1 . For example, in other embodiments, video-cod- 
ed data may be sent by an encoder such as encoder 
110 to devices other than a decoder. For example, en- 
coder 110 may send video-coded data to a data storage 



facility for later use by a decoder. As another example, 
video-coded data may be sent from encoder 111 to a 
transmission device which transmits the data across the 
network. Similarly, in other embodiments, stored video- 
5 coded data that had been previously encoded may be 
transmitted to a decoder such as decoder 120 by a de- 
vice other than an encoder. 

[001 1 ] Network 1 30 may be any information systems 
network across which information can be sent. Exam- 

io pies of network 130 include the Internet, an intranet, a 
wireline telephone network, a wireless telephone net- 
work, a virtual private network, or any combination of 
these networks. Encoder 110 may be used to encode 
video data, such as video signals 112, for transmission 

*5 across a network as video-coded frames. Encoder 1 1 0 
may output video-coded data that complies with a video- 
coding standard or algorithm such as MPEG-1 , MPEG- 
2, MPEG-4, H.261, and H.264. In FIG. 1 , encoder 110 
is shown coupled to a video camera 1 1 1 . In an embod- 

20 iment, video camera 111 outputs video signals 112 to 
encoder 110. In other embodiments, encoder 1 1 0 may 
encode prerecorded video signals or may receive other 
types of input such as animation, text, or audio data. 
Decoder 1 20 may be used to receive and decode video- 

25 coded frames for display as video images. Decoder 1 20 
is shown coupled to monitor 1 21 and may output decod- 
ed video data, such as video signals 122, for display as 
video images on monitor 121 . 
[0012] As shown in FIG. 1, network 130 includes a 

30 network access server 131 that connects encoder 110 
to network 130 and a network access server 132 that 
connects decoder 120 to network 130. Network access 
server 131 and network access server 132 may permit 
connections to network 1 30 from outside the network 

35 and may be operated by a third-party such as AT&T 
Corp.® or America Online, Inc.® Network 130 includes 
a network administrator 133 which administers opera- 
tion of network 130. In an embodiment, network 130 
may be decentralized and may contain multiple network 

to administrators. Fig. 1 shows a high priority channel 134 
and a low priority channel 1 36 coupling network access 
server 131 to network access server 132. In an embod- 
iment, high priority channel 1 34 and a low priority chan- 
nel 136 are logical paths across network 130, and data 

45 may be transmitted across each logical path using var- 
ious physical paths. In an embodiment, network 130 
contains a plurality of virtual circuits that may be used 
to transmit high priority traffic and a plurality of virtual 
circuits that may be used to transmit low priority traffic. 

so in an embodiment, network 130 contains a plurality of 
nodes, such as router or switches, and many of these 
nodes may be used to transmit data for both high priority 
channel 134 and low priority channel 136. 
[001 3] A person of skill in the art would appreciate that 

55 the amount of traffic across network 1 30 may be dynam- 
ic, and thus that the amount of available bandwidth may 
be constantly changing overtime. At any given time, net- 
work 130 may experience congestion and may be una- 
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ble to provide bandwidth for transmitting additional data. 
When network congestion occurs, network 130 may 
take appropriate actions such as dropping data or buff- 
ering data. For example, if a data packet XYZ is sent 
from netwo rk access server 1 31 to be forwarded across s 
network 130 to network access server 132, but network 
1 30 does not have the bandwidth to transmit data packet 
XYZ, then data packet XYZ may be dropped and a mes- 
sage indicating this dropping may be transmitted back 
to encoder 1 1 0. In an embodiment, network 1 30 will drop 
low priority packets before dropping a high priority pack- 
et. Network 130 may impose an additional charge for 
the transmission of data on a high priority channel. 
[0014] In an embodiment, network administrator 133 
maintains information about the amount of currently 
available network bandwidth and may provide informa- 
tion about current network capacity and expected future 
network capacity as feedback to encoder 110. For ex- 
ample, encoder 110 may send a network capacity re- 
quest 115 through network access server 131 to net- 
work administrator 1 33, and in response network admin- 
istrator 1 33 may send network capacity information 116 
through network access server 1 31 to encoder 110. Net- 
work capacity request 115 may be a request for infor- 
mation about the availability of capacity to send a type 
of data (e.g., a high priority frame or base layer frame), 
and network capacity information 116 may be a re- 
sponse to such a request. In an embodiment, a request 
for information sent from encoder 110 does not specify 
the type of data to be transmitted (e.g., that the data is 
video-coded frames) and may be, for example, a re- 
quest for a specified amount of bandwidth. In this exam- 
ple, the priority of the bandwidth, the size of the data, 
and/or the duration may be specified. In an embodiment, 
a request is not required for the sending of network ca- 
pacity information 116, and network capacity informa- 
tion may be sent, for example, on a periodic basis or 
during conditions determined by network administrator 
1 33. Of course, a person of ordinary skill in the art would 
appreciate that network capacity request 115 and net- 
work capacity information 116 may be transmitted be- 
tween encoder 110 and network access server 131 us- 
ing the same connection as the video-coded frames 
113. Embodiments of the present invention that make 
use of this network capacity information when transmit- 
ting video-coded information are further described be- 
low. 

[0015] FIG. 2 is a block diagram of a video encoder 
according to an embodiment of the present invention. 
FIG. 2 shows an encoder 110 such as in FIG. 1 above. 
In addition, FIG. 2 shows a stream of video signals 112 
that is coded by encoder 110 and transmitted as a 
stream of video-coded frames 113 across network 130 
over two logical channels (high priority channel 1 34 and 
low priority channel 1 36). FIG. 2 shows six video frames 
that may be part of the same stream of video data. The 
first four frames in the stream (i.e., 1 st video frame 221 , 
2 nd video frame 222, 3rd video frame 223, and 4th video 



frame 224) have already been encoded and are being 
transmitted over network 130, while the other two 
frames (5 th video frame 225 and 6 th video frame 226) 
consist of uncoded data that is being transmitted for cod- 
ing to encoder 110 by, for example, video camera 111 
of FIG. 1 . Of course, each of the video-coded frames 
may comprise multiple frames of uncoded video data. 
As discussed above, the video-coded frames may also 
include non-video information such as animations, text, 
control information, and/or audio information. In the em- 
bodiment shown, each of the video-coded frames 113 
transmitted across network 130 contain a priority level 
field. A frame that has a low priority level such as 2 nd 
video frame 222 is transmitted on low priority channel 
136. In an embodiment, the priority level is built into the 
video-coded frame when it is encoded. In other embod- 
iments, the priority level may be added to a video-coded 
frame after the frame is encoded or may be transmitted 
to network 1 30 as a data element separate from the vid- 
eo-coded frame. 

[001 6] As shown in FIG. 2, encoder 1 1 0 contains en- 
coding logic 117 and transmission priority setting logic 
1 1 8. Encoding logic 1 1 7 may be used to encode the vid- 
eo data. Transmission priority setting logic 118 may 
send network capacity requests 115 and may receive 
network capacity information 116 in response to these 
requests. Transmission priority setting logic 118 may 
use the network capacity information to select a trans- 
mission priority for each of the video-coded frames 113 
according to an embodiment of the present invention 
such as the method discussed below. Of course, encod- 
er 1 1 0 may contain additional components such as logic 
to control the transmission of data to network 130. As 
would be appreciated by a person of ordinary skill in the 
art, encoder 110 may also contain an analog-to-digital 
converter, transform logic, quantizer logic, and predic- 
tion logic. The components in encoder 110 may be em- 
bodied in software, hardware, firmware, or some com- 
bination. Encoder 110 may include one or more central 
processing units (CPUs), random access memories 
(RAMs), and Read Only Memories (ROMs), and mem- 
ories in encoder 1 30 may store instructions to be exe- 
cuted by a processor to carry out embodiments of the 
invention as described herein. The logic in encoder 110 
may be embodied in a special purpose processing unit 
such an application specific integrated circuit (ASIC). In 
an embodiment, encoder 110 is a personal computer 
(PC) that contains software to carry out an embodiment 
of the present invention. 

[0017] FIG. 3 is a flow diagram of a method of trans- 
mitting video information according to an embodiment 
of the present invention. The description below is ex- 
plained with reference to the systems shown in FIGS. 1 
and 2, but of course these methods may be used with 
other systems. As shown in FIG. 3, a frame of video data 
to be coded as video-coded data is received (301 ). For 
example, a frame of video data may be received at en- 
coder 110 from video camera 111 or may be received 
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from a buffer in another part of encoder 110. In embod- 
iments, the frames of video data may already be stored 
at the encoder (e.g., buffered at the encoder) prior to 
coding. The encoder may send a request for information 
relating to the network's available capacity to transmit 
high priority data (302), and capacity information may 
be received in response to the request (303). Examples 
of the request and response are shown in FIG. 1 as net- 
work capacity requests 1 1 5 and network capacity infor- 
mation 116. In an embodiment, network administrator 
133 will determine if the capacity to send high priority 
data is available and will send a response to encoder 
110. If the response indicates that the network has the 
capacity to transmit the frame as high priority data (304), 
then the frame is encoded as a high priority frame (e.g., 
a base layer frame) (305) and is transmitted as high pri- 
ority data (306). If the response indicates that the net- 
work does not have the capacity to transmit high priority 
data (304), then the frame is encoded as a low priority 
frame (e.g., an enhancement layer frame) (307) and is 
transmitted as low priority data (308). Frames that are 
transmitted as high priority data may use a high priority 
channel across network 130 and frames that are trans- 
mitted as low priority data may use a low priority channel 
across network 130. 

[0018] FIG. 4 is a flow diagram of a method of trans- 
mitting video information according to another embodi- 
ment of the present invention. As in the previous em- 
bodiment, the encoder may receive a frame of video da- 
ta to be coded as video-coded data (401), may send a 
request for information relating to the network's availa- 
ble capacity to transmit high priority data (402), and may 
receive capacity information in response to the request 
(403). In this embodiment, the data is video-coded (404) 
and the video-encoded frame is buffered (405) at sub- 
stantially the same time as the request is sent and/or 
the response to the request is received. If the network 
has the capacity to transmit the frame as high priority 
data (406), then the request is transmitted as high pri- 
ority data (407). If the network does not have the capac- 
ity to transmit high priority data (406), then the video 
frame is transmitted as low priority data (408). In some 
embodiments, such as very high compression codecs, 
the frame has to be recoded as a high priority frame. In 
other embodiments, the frame may have been coded at 
both priorities (high and low) in parallel, and the frame 
with the desired priority may be chosen at a later time. 
[0019] FIG. 5 is a flow diagram of a method of trans- 
mitting video information according to another embodi- 
ment of the present invention. FIG. 5 contains steps 401 
to 407 as in FIG. 4. In this embodiment, however, the 
encoded frame is deleted from transmission (500) if the 
network does not have the capacity to transmit high pri- 
ority data. When an encoded frame is deleted from 
transmission, the video data may be lost, but such a loss 
may not greatly impact perceived picture quality as long 
as the encoder 11 0 is aware of the loss. 
[0020] FIG. 6 is a flow diagram of a method of trans- 



mitting video information according to another embodi- 
ment of the present invention. As discussed above, a 
frame of video data to be coded as video-coded data 
may be received (601). In this embodiment, the frame 

5 is then encoded as a high priority frame (602). In this 
embodiment, ail frames may be encoded as high priority 
frames prior to requesting and/or receiving any informa- 
tion about available network capacity. As shown in FIG. 
5, after encoding the high priority frame, a request for 

10 information relating to the network's available capacity 
to transmitting high priority data is sent (603), and ca- 
pacity information is received in response to the request 

(604) . If the network has the capacity to transmit the 
frame as high priority data (605), then the request is 

15 transmitted as high priority data (606). If the network 
does not have the capacity to transmit high priority data 

(605) , then the video frame is transmitted as low priority 
data (607). 

[0021] FIG. 7 is a flow diagram of a method of trans- 

20 mitting video information according to another embodi- 
ment of the present invention. A frame of video data to 
be coded as video-coded data may be received (701 ). 
In this embodiment, frames are encoded as either high 
priority frames or low priority frames based on a priority 

25 selection algorithm (702). The algorithm may use infor- 
mation about how much bandwidth is allocated for the 
transmission of high priority frames. The encoder then 
obtains information relating to the network's available 
capacity to transmit high priority data (703). This infor- 

30 mation may be obtained by network feedback or other 
means such as the Real Time Control Protocol (RTCP) 
from the Internet Engineering Task Force (IETF). If more 
than a threshold number of low priority frames have 
been lost (704), then an additional number of the frames 

35 may be encoded as high priority frames than is dictated 
by the transmission priority algorithm discussed above. 
These additional high priority frames may be encoded 
at a tower quality than is generally used for high priority 
frames. 

40 [0022] The present invention improves the transmis- 
sion of video information by using network feedback on 
available bandwidth. Through the use of feedback the 
present invention allows for the randomization of the ar- 
rival of high priority data into the network and, therefore, 

45 minimizes the likelihood of network overload. The 
present invention may also avoid the buffering of large 
amounts of data and the ensuing delay that such buff- 
ering may cause. Several embodiments of the present 
invention are specifically illustrated and/or described 

50 herein . However, it will be appreciated that modifications 
and variations of the present invention are covered by 
the above teachings and within the purview of the ap- 
pended claims without departing from the spirit and in- 
tended scope of the invention. For example, unless oth- 

55 erwise specified, the order of the steps performed may 
be varied. 

Where technical features mentioned in any claim are fol- 
lowed by reference signs, those reference signs have 
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been included for the sole purpose of increasing the in- 
telligibility of the claims and accordingly, such reference 
signs do not have any limiting effect on the scope of 
each element identified by way of example by such ref- 
erence signs. 



Claims 

1. A method of transmitting information comprising 
transmitting video-coded information over a net- 
work at a priority level that is determined based on 
feedback from the network. 

2. The method of claim 1 , wherein the feedback com- 
prises a response to a request for information on 
whether the network-currently has available capac- 
ity to transmit additional high priority traffic. 

3. The method of claim 1 , wherein said transmitting 
video-coded information comprises: 

receiving a frame of video data to be encoded; 

requesting permission to send high priority data 
over the network; 

receiving a response to the request for permis- 
sion to send high priority data; and 

encoding and transmitting the frame as a high 
priority video-coded frame if permission was 
granted to send high priority data. 

4. The method of claim 3, wherein said transmitting 
video-coded information further comprises encod- 
ing and transmitting the frame as a low priority 
frame if permission was not granted to send high 
priority data. 

5. The method of claim 3, wherein said transmitting 
video-coded information further comprises deleting 
the video-coded frame from transmission if permis- 
sion was not granted to send high priority data. 

6. The method of claim 1 1 wherein said transmitting 
video-coded information comprises: 

requesting permission to transmit high priority 
data; 

encoding and buffering a high priority video 
frame at substantially the same time as said re- 
questing permission to transmit high priority da- 
ta; 

transmitting the encoded video frame over the 
network as high priority data if permission to 
send high priority data was granted; and 
deleting the encoded video frame from trans- 



mission if permission to send high priority data 
was not granted. 

7. The method of claim 1 1 wherein said transmitting 
5 video-coded information comprises: 

encoding as high priority frames ail video 
frames that are to be transmitted; 

10 for each of said coded frames: 

requesting permission to send high priority 
data; 

is transmitting the frame as a high priority 

frame if permission to transmit high priority 
data was granted; and 

transmitting the frame as a low priority 
20 frame if permission to transmit high priority 

data was not granted. 

8. The method of claim 7, wherein the high priority 
frames are transmitted over the network separately 

25 than the low priority frames, wherein the high prior- 
ity frames are transmitted over the network using a 
guaranteed quality of service trunk, and wherein the 
low priority frames are transmitted over the network 
on a best-effort truck. 

30 

9. The method of ciaim 1 , wherein said transmitting 
video-coded information comprises: 

encoding a plurality of frames as either high pri- 
35 ority frames or low priority frames according to 

a priority selection algorithm; 
receiving information about loss of low priority 
frames by the network; and 
if more than a threshold amount of low priority 
40 frames are being lost, encoding an additional 

number of the frames as high priority frames 
than is dictated by said algorithm, wherein said 
additional high priority frames are encoded at 
a lower quality than is generally used for high 
45 priority frames. 

10. A method for transmitting video-coded information, 
the method comprising: 

so receiving video data to be coded into a video- 

coded frame; 

requesting information relating to a network's 
available capacity to sending high priority data; 
receiving capacity information in response to 
55 said request; and 

transmitting the video data as a video-coded 
base layer frame if the capacity information in- 
dicates that the network has capacity available 
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to send high priority data. 

1 1 . The method of claim 1 0, wherein the method further 
comprises transmitting the video data as a video- 
coded enhancement layer frame if the capacity in- 
formation indicates that the network does not have 
capacity available to send high priority data. 

12. The method of claim 1 0, wherein base layer frames 
are transmitted over the network separately than 
enhancement layer frames, wherein base layer 
frames are transmitted over the network using a 
guaranteed quality of service trunk, and wherein the 
enhancement layer frames are transmitted over the 
network on a best-effort truck. 

1 3. The method of claim 1 0, wherein the method further 
comprises deleting the video data without transmit- 
ting said video data if the capacity information indi- 
cates that the network does not have capacity avail- 
able to send high priority data. 

14. The method of claim 10, wherein the video data is 
encoded as a base layer frame and buffered at sub- 
stantially the same time as said requesting informa- 
tion relating to the network's available capacity, and 
wherein said buffered frame is deleted if the capac- 
ity information indicates that the network does not 
have capacity available to send a high priority data. 

1 5. The method of claim 1 0, wherein received video da- 
ta is coded as a base layer frame prior to receiving 
information relating to the network's available ca- 
pacity, and wherein said buffered frame is transmit- 
ted as an enhancement layer frame if said informa- 
tion indicates that the network does not have capac- 
ity available to send a high priority data. 

16. A method of transmitting video-coded information 
over a network comprising: 

determining that a candidate base layer frame 
is available to be encoded; and 
before encoding the candidate base layer 
frame, requesting permission from the network 
to send high priority data. 

1 7. The method of claim 1 6, wherein the method further 
comprises: 

receiving a response from the network to the 
request which response provides permission to 
send high priority data; 

coding the candidate base layer frame as a 
base layer frame; and 

transmitting the coded base layer frame over 
the network. 



1 8. The method of claim 1 6, wherein the method further 
comprises: 

receiving a response from the network to the 
s request which response denies permission to 

send high priority data; 

coding the candidate base layer frame as an 
enhancement layer frame; and 
transmitting the coded enhancement layer 
10 frame over the network. 

1 9. The method of claim 1 6, wherein the method further 
comprises: 

*5 receiving a response from the network to the 

request which response denies permission to 
send high priority data; and 
deleting the candidate base layer frame. 

20 20. A method of transmitting video-coded information 
over a network comprising: 

determining that a candidate base layer frame 
is available to be encoded; 
25 requesting permission from the network to send 

high priority data; 

encoding the candidate base layer frame and 
buffering the encoded frame at substantially the 
same time as requesting permission from the 
30 network to send high priority data; 

transmitting the buffered frame as a base layer 
frame if permission to send high priority data is 
granted; and 

transmitting the buffered frame as an enhance- 
as ment layer frame if permission to send high pri- 
ority data is denied. 

21 . The method of claim 20, wherein base layer frames 
are transmitted over the network separately than 

40 enhancement layer frames, wherein base layer 
frames are transmitted over the network using a 
guaranteed quality of service trunk, and wherein the 
enhancement layer frames are transmitted over the 
network on a best-effort truck. 

45 

22. A method of transmitting video-coded information 
over a network comprising: 

receiving a plurality of video frames to be cod- 
so ed; 

for all of the video frames received: 

requesting permission from the network to 
transmit a high priority frame; 
55 coding the video frame as a high priority 

frame; 

transmitting the coded frame as a high pri- 
ority frame if permission to transmit a high 
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priority frame is received; and 
transmitting the coded frame as a low pri- 
ority frame if permission to transmit a high 
priority frame is denied. 

5 

23. The method of claim 22, wherein requesting per- 
mission from the network and coding the video 
frame are done at substantially the same time. 

24. A method of transmitting video-coded information m> 
from an encoder over a network comprising: 

receiving information from the network on how 
much bandwidth is allocated to the encoder for 
high priority frames; *s 
encoding a plurality of frames as either high pri- 
ority frames or low priority frames according to 
a priority selection algorithm and based upon 
said received bandwidth information; 
receiving information about loss of low priority 20 
frames by the network; and 
if more than a threshold amount of low priority 
frames are being lost, encoding an additional 
number of the frames as high priority frames 
than is dictated by said algorithm, wherein said 25 
additional high priority frames are encoded at 
a lower quality than is generally used for high 
priority frames. 

25. The method of claim 24, wherein information about 30 
loss of low priority frames by the network is received 

as network feedback. 

26. The method of claim 24, wherein information about 
loss of low priority frames by the network is received 35 
using Real Time Control Protocol. 
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FIG. 3 
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FIG. 4 
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FIG. 5 
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FIG. 6 
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FIG. 7 
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